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INSPECTION OF PRINTED CIRCUIT BOARDS USING COLOR 
pTITT T> QF THF j ^JVHNTION 
The present invention is related to the field of inspection of patterned surfaces, such as 
printed circuit boards and in particular to the identification of certam^^ 
5 as conductor oxidation, using color. 

BACKGROUND of THF TNVW.TON 
One widely used method for inspection of W printed circuit boards havmg 
mctalized portions and, unmetalked, laminate portions is to: 

(8 ) muminate the board with tight which appears to come from a wide range of angular 

10 directions; 

(b) image the iUuminated portion; 

(e) define the metalized portions from the image of the board; and 
(d) determine defects in metatization on the board by one or more of comparison of the 
i^ewimastandamimageandana^ 

is determine ifilmeeB the rules. 

Among prior ta publtamomt which describe such methods sre US Patento 4,75 MM. 
5,619,429; 5,774472; tmd 5.774,573. the dsctomrea ef which ere i»co*omted hemm by 

""""L of the ptobtans in making this comparison i. me detemurmlion of edges boween 
^ covered by cmductera on ft. bmnd and — without «— • * -» ° f 
pubneauona, inchufing. for — *. US Fnten. SgHS, «» **~ " <** " 
Lrporated htai. by refta.ee. have soggCcd mc ose of color to nnpreve fin. 
n^^nnonon. In ^ these methods imsge dte bomd utilizing . Cor » - «« 
conns, between the oanducror. tmd arena from which me couductera have been removed t. 
^ l This ma, be acbiered b, Olunrinating dm rarfcee wim Ugh, ^ J™ 
contius, or by filtering Urn light which is reOecmd prior „ fbtmmg -he mmge In parties, me 
shove referenced US Patent 5,524,1 52 generates one or more different images each based oo a 
dflfcrent filter to emptastre different materials, such as gold copper, etc. 

US Paten, 5,483.603, dm disclosure of which is incorporated by reference, defines a 
„^„n in RGB space that chamtarisea a endnote, and a region in ROB space J* 
dum ^, 1 ^Pi^ta^-»ta«hmmm ^tantatedapcndrngcmwlm* 

regions contains their RGB values. 
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While ideally, the board should consist of only two types of areas, namely metal and 
bare substrate, unfortunately the metalization on a board is sometimes oxidized. Furthermore, 
several types of oxidation and various levels of severity of oxidation exist, making it difficult 
to determine criteria for reliably identifying oxidation. 

Since oxidation is a widespread phenomena in printed circuit board manufacture, 
especially when me boards have been in storage for a considerable period of time and/or have 
been stored under less than ideal conditions, it would be useful to be able to rehably dctonnne 
areas of oxidation on printed circuit boards. Such identification could be useful, for example, 
in avoiding classification of such areas as containing defects. 

VJfM/WV OF TffP INVENTION 
In a broad aspect of the invention, the present invention determines the presence of 
oxide on a conductor on a printed circuit board from an image of the printed circuit board. 

In accordance with some preferred embodiments of the invention, color charactensucs 
of light reflected from the surface of a printed drcuit board are used to determine if the area » 
an oxidized conductor. The method of the present invention may be used in any nnagmg 
system in which images at multiple colors are acquired. 

According to one broad aspect of the present invention, the presence of an oxide (or 
another definable aspect of the pixel) is deterrnined by comparing the color characteristics of a 
suspect pixel with the color characteristics of either the metalization or laminate portions. 

20 preferably, the metal portions. 

According to a second broad aspect of the present invention, the presence of an oxide 
(or another definable aspect of the image) is determined by comparing the color components of 
a suspect pixel utilizing a normalizing scale based on foe color characteristics of either foe 
metalization or laminate portions, preferably, the metal portions. 

According to a third broad aspect of foe present invention, foe presence of an oxide is 
deterrninedby first finding a region of foe color space which is characteristic of oxide and then 
determining if the color values of a pixel is within this region. 

In accordance with one aspect of some preferred embodiments of foe invention, foe 
determination of an oxide is made without directly excluding foe presence of a laminate. In 
30 aafotion.fosomeprefer^embodim 
not near an edge) are classified as oxide. 

In a preferred mbodiment of foe invention each of foe color scales for RGB is first 
normalized between a low tight level and foe reflection from fine (unoxidized) copper. 
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. . *. U i^r— «* •* toel - For — ** porno ° f T 

for 8 bit quantification of li^itleveL 

M is d«ermmed «, . be . F.r oto Pixds. fcr wbieb no. W 

„ *. level of otber coto If *• «— M> «- 

„ *•-■*** 
presence of omerojidistypei. 

m o*=r preferred embodiment of.be taction, a company made w»b bngbOKss 

levels of the laminate. . , - j/ 

Si^lar compartona » oaeml fox dcttnmnmn orber type, of oxrda.0. and*. 

-* a, eoH M or do* be** c^s — • »*- « — 

laminate, photoresist residues or dust 

iL is thus provided, in accordance with a preferred embodiment of the mvenbo., a 

method of analysis of a printed circuit board comprising: 
20 gcneiatmgvaninMg^ 

determining the presence of an oxide from an analysis of the unage. 

. . rrtw> nr—tnee of an oxide is made without determining 
Preferably, determination of the presence 01 an wuw 

whether the pixel is a laminate pixeL 

«— * - <■» ecK,ains " T 

t^. «*» for each pixe. deunnmb. fte of «- - - -* «»°^» 
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dete^gtheprese^^ 

Preferably. 6 e»ona« - image eompnses ee^enmog . plpmb t, o W. _ 

«»oo& i ^i^s^^^««^^ ;B *f ! ^2; 

pa* ■■ ■■ ^ , . ^^A^k««i^hrim analysis OKth&ipoxei/ 



i^^ v a;blue;imagQ. . 
^gli!...... **— dimm^pueUfa- 

considemnoo b^sed on^n^ .aloe » Prefer, m, cotor is red - 
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pixels having* ted Whmess. level below ^^y^M^n.i^ torn con****** , 
Jbeing loxidf Preferably, the color is red and wherein pixels having a red value above a 
given value are eliminated fipDaj^a^on_as being an oxide. 

In apxeferred^bodHnent of the invention, detennination of the presence of an oxide 

; includes eliminating pixels fi^ m ^^ *«*»*? ' 

W***» ■«*+ Preferably; ifm^**^*^*^*™* 
Eliminated if its red brightness value compared to that of copper is less than ,ts green 
brightness value compared to copper. Preferably, the two colors are red and blue and wherein 
the pixel is eliminated if its red brightness value compared to that of copper is less than .ts blue 

o brightness value compared to copper. 

fa a preferred embodiment of the invention, detennination of the presence of an oxide 
includes eliminating pixels from consideration based on an analysis of the brightness levels of 
three colors. 

In a preferred embodiment of the invention, detennination of the presence of an oxide 
l5 includes eluninating pixels from consideration based on a comparison between the brightness 
tevdofte^SbTo^ 

consideration as an oxide when its color brightness values have a Mahalanobis distance greater 
than a given value from the mean values of the brightness values for copper. Preferably, the 
given value for the Mahalanobis distance is between 4 and 8, more preferably, about 6. 
M In a preferred embodiment of the invention, the deterrnination of the presence of an 

oxide is made based on a jel^^ 
brightness v alues characteristic of copper. 
Preferably, the method includes: 
determining a color gamut characteristic of the oxide; and 
25 comparing the color values of a pixel to the determined gamut of values to determine if 

the pixel is an oxide. 

There is further provided, in accordance with a preferred embodiment of the invention, 
a method of multi-color image processing, comprising: 

generating a plur ality of images of an object, said images being acquired at different 

30 wavelengt h ranges ; 

determining gradient values in the image; and 

analyzing the multi-color images to determine characteristics of the object, 
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f ti,P imacB at or near high gradients are analyzed differently fiom 
wherein regions of the image ax or ncui 

, to pmfened embodtomm. of me I—* - — ^ - ^ 

fl. invention will be mom M «ndo*ood *- * f ° UWi ° 8 toOTPMn ° f 

to . pmfmmd embodime* of dm "—f ™" 

«d by light and imaged in a plurality of 

RG B Whim to methods of too invermon am applicable to any imaging 8 ^'**™ 1 which 

^P^d^nftonw^m^nmde^tod^ 
presence of browojixjde, three enter images, namely R, G and B images ate ^^^^ 

^ZgSttti'iiZ* i— -- smndnm hgh, division (mm assoc«d 
overiapping sensitivity) is used. r , 4 

AS a tost prefer step in me oefctminaion, a s«-op U P^»<*^ 

^feeofoeide.Peefemhry.anop^c^apomon.fmeh^whKhhas.mta 
ofm^orei^pixels, edge pixeU^aonm pntels. 

First, the brightness of Ihe ntominanon and the camera and A/D 

1 ^eTdam level of ^ iOjSd a v-ue »r a enpper piam «*-£S£* bit 



30 



quantification of light level 



Lcanonoiusmi^Tw. m r.«K^sw«&pW 

Tbe next step i^%*^^ 

1DBn H t J 1 ^ Vsr = ^V ,lf ; w ' Ti^Urt This calculation is in 

(pixels on or near transitions between conductor and laminate). This catcuiau 
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WSySAS^ Other a**.!* -d mrfK* of *5*8 *«* <-> * — 

5 instead of the "low-sure" threshold. 

The nexTstepin the set-up is to produce a 3-D histogram of the colors of all the mtenor 

c^pixelsmtheregionoflirnrtedsize.Ith. 
gives adequate statistics. For the 3-D histogram, the 

Z^TTT S (^) ^ _ 

This matrix is inverted to form an inverted covariance matrix. This inverted matrix is 
used to determine if apixeik^g^^S. 

15 pixels in a PC board under test to determine if a pixel is oxidized. 

1) if the pixel is at a strong gradient (for example, it is an edge pixel), it is not checked 

and is not marked as an oxide; 

2) if is Mahalanobis distance (as defined below) from the mean value of copper prxels 
is less than some given value, it is not an oxide; This value may vary between about 4 and 8, 

20 with 6 being a preferred value; 

3) if the red pixel value is less than the low-sure threshold for red, it is not classified as 

an oxide (it is definitely laminate); 

4) optional, if red is less than green forapixeL it is not classified as an oxade; 

5) 6ptio.>ally.ifn*lis^^ 

6) optionally, if the red value is greater than some high value (for example, 220) it rs 

not classified as an oxide. 

The Mahalanobis distance for a pixel is determined by forming a vector and pre- 
multiplymg the inverted covariance matrix by the vector and then post-multiplying the product 
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by the transpose of the vector. The scalar that results from tins "modified inner product" of the 
vector is the square of the Mahalanobis distance . 

. A preferred algorithm for dcternuning if a pixel is at a strong gradient 0*. »t is 
considered to be an edge pixel and thus not subj ect to the above analysis) is: 
5 Let I[x,y] be fee gray level value of the red image at location (x,y). 
To calculate if the pixel at location (x,y) is an edge pixel: 

Let .-«Cl*r2tfW*l^^ 

l0 + ceo(IIx,y-2],IIx,y-l^^ 

+ cedOlx-2,y-2]J[x-l^-iyix,yy5H-l.y+l i 
+ c^x-2,y+2]4lx-l.y+l)Jlx,yyix+l.y-iyix+2of-2]) 

where the functions ceoO and cedO are detmed by me computer program 
IS fragment below. 

Then if s >= 12, the pixel at (x,y) is an edge pixeL 

> typedef unsigned char uchar; 

20 > static int sstf4][4] = { {1, 2, 2, 2), {2,-1, 2, 2), 

> {2,2,0,0), {2,2,0.0)); 

> 

>intf(mtd) 

25 > { retum(abs(d)<4?0:(abs(d)<8?l: 

> (abs(d)<12?2:(abs(d)<16?3: 

> (abs(d)<24?4:(abs(d)<36?5: 

> (abs(d)< 128 7 6 : 7)))))))* (d< 07-1:1); 

30 >) 

> void hlffloat dl, float d2, int *s, float *v) 
>{ 

> *v = 0375*dl+0.125*d2; 

35 > 

> if(fabs(*v)<03) 

> •s = (fabs(dl)<0.1)72:3; 

> else { 

> *s = (*v>0)?0: 1 ; 

40 > ) 

> *v = fabs(*v); 

>} 
> 

>intctCmtd[4]) 

45 > { 

> ints,sl,s2; 

> float vl,v2, ret; 

> int t, v; 

7 
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> ht(-d[l],-d(0],&sl,&vl); 

> ht(dl2],d[3],As2,&v2); 

> 

5 > ret = (vl+v2+l)/2; 

> if(ret>3) 

> ret = 3; 

> if (ret < -3) 

> ret = -3; 
10 > v = (int) ret ; 

> 

> s = sst[sl][s2]; 
> 

> if (8 = 2) { 

15 > if(fcbs(vl)>2||febs(v2)>2) 

> t = 4; 

> else 

> t = 0; 

> ) 
20 > else 

> t = 0; 
> 

> return t; 
>} 

" > int ceoCuchar gO, uchar gl, uchar g2, uchar g3, uchar g4) 
>{ 

> intd[4]; 
> 

30 > d[0] = f(gi-g0); 

> d[l] = f(g2-gl); 

> d[2] = fl(g3-g2); 

> d[3] = f(g4-g3); 

> return ct(d); 
35 >} 

> int ced(uchar gO, uchar gl, uchar g2, uchar g3, uchar g4) 
>{ 

> intd[4]; 
40 > 

> d(0] = f((gl-gO)/sqrt(2)); 

> d[l] = f((g2-gl)/sqit(2)); 

> d[2] = f((g3-g2)/sqit(2)); 

> d[3] = flKg4-g3)/sqrt(2)); 
45 > return ct(d); 



> } In an alternate preferred embodiment of the invention, a multi-dimensional region of 
color space chamcteristic of an oxide, whose presence btobetes^ is.dj^ed.S^a 
determination may be made^^^^^^^^^^^^^ 7 
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range, in color space, of the images. During, testing, the color values of teat pixels are 
• ^SlpT^^^^a^^^^E'lf the values are within the region, the pixel 

classification as oxides. While such j&maps have been used, in the past, to djternnne metol 
5 ^dlarnu^c^ve not beenused to detennine the presence of oxide and have not been 
^ in conjunction with gradient information. Furthermore, this method is easily adapted to 
testing for other types of oxide and even to the presence of dust on conductors- 
One preferred use of the information determined by the above described method is in 
avoiding the classification oxide or dust pixels as faults ma printed circuit board. Since these 
,0 pixels generally have a brigfatne^tween th^oXcpj^and Jannn^ they may sometimes 
be classified as laminate by normal threshold programs. ^g^^V^mSSmSS9 
difficulty in determining edges near oxide. Thus, when me above method determines that a 
pixel is oxide, it is, for the purposes of a mult drtennination program, defined as a metal pixel. 
The present invention has been described in conjunction with preferred, rmn-lhmlmg, 
15 embodiments thereof. It should be understood that variations on these embodiments, within the 
scope of the invention, as defined by the following claims, will occur to persons of skill in the 
art In the following claims, where the words "comprising," comprises," mcludmg" or 
"includes" are used these words mean that the apparatus or method includes the foUowmg 
structure or steps, but may (but need not) include other structure or steps. 
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CLAIMS 

1. A method of analysis of a printed circuit board comprising: 
generating an image of the printed circuit board; and 
determining the presence of an oxide from an analysis of the image. 

2. A method according to claim 1 wherein determination of the presence of an oxide is 
made without determining whether the pixel is a laminate pixel. 

3. A method according to claim I or claim 2 wherein generating an image comprises 
generating a pixelated image having brightness values for each pixel and wherein determining 
the presence of the of an oxide comprises detennming the presence of the oxide responsive to 
the brightness values. 

4 A method according to claim 1 or claim 2 wherein generatmg an^in^wmprisK 

generating a?pluripy£Qf^ 
|fcel*mieaca>:ir^ 
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20 5. A method according to claim 4 wherein the plurality of images comprises a red, a green 
and a blue image. 

6. A method according to claim 4 or claim S wherein deterrmnation of the presence of an 
oxide includes elirrnnating pixels from consideration based on^bjgtoe^yahw^ajsmgW 

25 mm 

7. A method according to claim 6 wherein the color is red and wherein pixels having a red 
brightness level below a given value are eliminated from consideration as being an oxide. 

30 8. A method according to claim 6 or claim 7 wherein the color is red and wherein pixels 
having a red value above a given value are eliminated from consideration as being an oxide. 
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9 A method according to any of claims 6-8 wherein deterrrunation of the presence of an 
oxide includes eliminating pixels from consideration based on a comparison between the 
brightness l^^twSxoIo^. 

10 A method according to claim 9 wherein the two colors are red and green and wherein 
the pixel is eliminated if its red brightness value compared to that of copper is less than « 
green brightness value compared to copper. 



20 



11 A method according to claim 9 or claim 10 wherein the two color, are red and blue and 
I0 wherein the pixel is eliminated if its red brightness value compared to that of copper * less 

than its blue brightness value compared to copper. 

12 Amet hod according to any of claims 6-11 wherein determination of the presence of an 
oxide includes eliminating pixels from consideration based on an analysis of the brightness 

15 levels of three colors. 

13 A method according to any of claims 6-12 wherein determination of the presence of an 
oxide includes elirninating pixels from consideration based on a comparison between the 
brightness level of three colors with brightoess levels for copper. 

14 A method according to claim 1 3 wherein a pixel is eliminated from consideration as an 
oxide when its color brightness values have a Mahalanobis distance greater than a given value 
ftom the mean values of the brightness values for copper. 

15. A method accenting to claim 14 wherein the given value for the Mahalanobis distance 
is between 4 and 8. 

16. AmemodaccordmgtoclaimUwheremm^ 
is about 6. 

17 Amethcdaccordmgmanyofch^^^ 

an oxide is made ba^donju^^ 
brightness valixes^haracteristic of i^ggg^ 

11 
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18. A method according to any of claim 4, 5 or 12 and comprising: 
determining a colo^^^dar^t^^feejoade; and 

comparing ±7colo7values of a pixel to the determined gamut of values to detennine if 
5 the pixel is an oxide. 

19. A method of multi-color image processing, comprising: 

generating /plurality of images of an object, said images being acquired at different 

wweJengtbJafigS^/' 
10 P^^^^l^^^^uesmtheimag^and 

analyzing the multi-color images to detennine characteristics of the object, 
wherein regions MM^ »» « near high . gradients are analyzed differently fiom 
omer regions jjfthe image. 

l5 20. A method according to claim 19 wherein the regions of high gradient are transition 
regions. 

21. A method according to claim 19 or claim 20 wherein the regions of high gradient are 
edge regions. 

^ 22. A method according to any of claims 19-21 wherein the regions of high gradient axe 
excluded from analysis. 

23. A method according to any of claims 19-22 wherein the regions of high gradient 
25 include ed ges between conductors and laminate. — 



24. A 



method according to any of claims 19-23 wherein the object is^printedcirarif 
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